***********************************************************
Cart Pole using Ordinary Bellman Equation
***********************************************************

Options used when running:

3: Cart Pole
31: Order --- this means we will have 30^4 = 810,000 weights to tune
1: No value averaging
0: Ordinary Bellman
20: Number of interations of value iteration
16: Number of threads used by value iteration (set to your number of cores)
16: Number of threads used to evaluate a policy (set to your number of cores)
1: Evaluate policy after every iteration
0: Print results to file
out_Ordinary_CartPole.txt: The file to print the results to

Console output:

Select environment:
[0] Mountain Car
[1] Puddle World
[2] Acrobot
[3] Cart Pole
[4] Pendulum Swing-Up and Balance
[5] Bicycle
Selection: 3
Enter the order (state is 4 dimensional): 31
Select value averaging:
[0] Yes
[1] No
Selection: 1
Select maxQ Variant:
[0] Ordinary Bellman
[1] Consistent Bellman
Selection: 0
Enter number of iterations of value iteration: 20
Enter number of threads for value-iteration (we suggest # available cores): 16
Enter number of threads for policy evaluation (we suggest # available cores): 16
Evaluate policy every how-many iterations? 1
Select Print results to file:
[0] Yes
[1] No
Selection: 0
Enter filename: out_Ordinary_CartPole.txt

Initially: Episode duration = 0.22
Iteration: 1	Episode duration = 0.22
Iteration: 2	Episode duration = 0.3
Iteration: 3	Episode duration = 20
Iteration: 4	Episode duration = 20
Iteration: 5	Episode duration = 20
Iteration: 6	Episode duration = 20
Iteration: 7	Episode duration = 20
Iteration: 8	Episode duration = 20
Iteration: 9	Episode duration = 20
Iteration: 10	Episode duration = 20
Iteration: 11	Episode duration = 20
Iteration: 12	Episode duration = 20
Iteration: 13	Episode duration = 20
Iteration: 14	Episode duration = 20
Iteration: 15	Episode duration = 20
Iteration: 16	Episode duration = 20
Iteration: 17	Episode duration = 20
Iteration: 18	Episode duration = 20
Iteration: 19	Episode duration = 20
Iteration: 20	Episode duration = 20
Printing results to out_Ordinary_CartPole.txt


